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Abstract 



(— I I Contrary to the theory of Markov processes, no general theory ex- 

ists for the so called nonlinear Markov processes. We study an example 
of "nonlinear Markov process" related to classical probability theory, 
merely to random walks. This model provides interesting phenomena 
(absent in classical Markov chains): continuum of stationary measures, 

^ ' conserved quantities, convergence to stationary classical random walks 
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1 Introduction 

Contrary to the theory of Markov processes, no general theory exists for 
the so called nonlinear Markov processes. Though a general definition of a 



nonlinear Markov process was introduced by H.P. McKean, [4] in his study 
of various models of kinetic theory. Subsequently various authors, see [5], [6], 
considered limits of stochastic many particles systems which lead to processes 
of this special type. 

Here we give an example of "nonlinear Markov process" which is close to 
classical probability theory, merely to random walks. It appears as a math- 
ematical model of a market with two type of agents or participants, tradi- 
tionally called bulls and bears. This model provides interesting phenomena 
(absent in classical Markov chains): continuum of stationary measures, con- 
served quantities, convergence to stationary classical random walks etc. It 
is important that our system has some relation to the Ornstein-Uhlenbeck 
process. This underlies main intuition and makes the system solvable. 

1.1 Simple random walks on Z with "discrete gaussian" 
stationary measure 

Consider a continuous time Markov chain rjt (simple random walk) on Z. 
The intensity of the jumps n ^ n + 1, n— T-n— 1 are correspondingly 

\ _ p-c{n-L). _ c{n-M) 

where c > and L and M are real numbers. The chain is ergodic and 
reversible. The detailed balance equations 

7r(?2)A„ = 7r(?2-h l)/i„+i (1.1) 

for the stationary measure tt have the unique solution 

TTfn) = 4e-(— )^ s = ^^±^. (1.2) 
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The normalization factor S = S(s, c) is given by 



m 7r 



where 

is the Jacobi theta function, see [1] p. 188. 



In addition to s we introduce another variable d = ^~^ ■ It is interesting 
that the invariant measure tt, which should depend on both parameters L 
and M, depends on s only. 

Let us note that the invariant measure does not change under the follow- 
ing transformation of the jump rates 

\n -^ Xn(3{n),fin -^ fin/3{n - 1), 

where /3{n) is an arbitrary positive function. This follows from the detailed 
balance equations for the invariant measure. In particular, /3{n) can be cho- 
sen so that the mean drift becomes asymptotically linear 

m{n) = Xn — Hn ^ —Cn, C > 

as for the classical Ornstein-Uhlenbeck process. Remind that the Ornstein- 
Uhlenbeck process is the unique stationary gaussian Markov process on M. 

1.2 Nonlinear walks and main results. 

Consider the vector-function 

X{t) = {L{t),M{t),p^{t),neZ) 
with (2 + oo) real functions on the interval t G [0, oo) and denote 

A„(t) =/3(n)e-'=("-^W),/.„(t) =/3(n-l)e^("-^W), (1.3) 

where c > is some constant. 

The vector- function X{t) is defined by the following infinite system of 
ordinary differential equations 

dj) 

—^ = Xn-lPn-l - {Xn + fJ'n)Pn + ^n+lPn+1, n G Z (1.4) 

dt 

-^ = -^VnXn + Cx (1.5) 

dM v^ ^ , , 

-^ = 2^Pn^ln-C^ (1-6) 

neZ 



together with the initial conditions L{0), M(0),p„(0). We will assume that 

Pn(0)>0,5^p„(0) = l. 

neZ 

Otherwise speaking, Pn{0) define the probability measure p(0) on Z. 

Apriori, Cx and C^ are some positive constants. If however, there exists 
at least one fixed point (L, M, tt) for these equations, then 

neZ neZ 

Then 7r„ satisfy equations (for fixed L, M) 

An-ivr„_i - (A„ + /i„)7r„ + /x^+ivr^+i = 0, 

which look exactly as Kolmogorov equations for stationary probabilities of 
the countable Markov chain. It is known (see [3], p. 59, th. 7.1) that the only 
/i-solution of these equations is positive (up to some multiplicative constant). 
Thus Tin satisfy also the detailed balance equations (II. ip . It follows that 
Ca, C^j, are equal 

Then using the variables s, d introduced above we rewrite (11.41 — TTlGl) in the 
following form: 

f^Jf) = e^'^[^{n - l)e'=(-"+i+")p„_i - (/3(ra)e'=(-"+*) + /?(« - l)e'=("-^))p„+ 
+/3(n)e^(~"-i+^)p„+i], neZ; 
s'{t) = -le'd (^„^^p„/3(n)e^(-"+«) - E„ezPn/3(n - l)e'=("-^)) ; 
[d'{t) = -le^'^ {EnezPnfiin)e<-''+'^ + Y.n&PnP{n - l)e^("-^)) + Ca, 

(1.7) 
where we have assumed the existence of the fixed point. First two equa- 
tions show that the trajectory of a pair (p, s) does not depend on d. This 
observation will help us in the proof of convergence. 

Remark. Now we want to explain some market model, which is the source 
of this paper. Assume that on the integer lattice Z all points of the interval 
(—00, 6] are occupied by "bulls" who want to buy and the points on the 



interval [b + l,oo) who want to sell. The boundary b = b{t) changes with 
time as follows. There are two Poisson arrival streams of demands: to buy 
with the rate A;, and to sell with the rate ^fe. When the buy demand arrives 
the boundary immediately moves fe — )■ 6+ 1, and conversely. The parameters 
L and M reflect the opinion of bulls and bears correspondingly, concerning 
the fair price. 

Define the Banach space B of vector-functions p = {Pn}n£z 'with the norm 



,n 



\P\ 



^|p„|exp(Y + a|n|), ae 

neZ 



Throughout this paper we assume that /3(n) satisfies the following condition 

sup/3(n) < oo. (1.8) 

Theorem 1. For any initial conditions such that p{0) G B zs the probability 
measure, the solution of the system U.7\) exists on the interval [0, oo) and is 
unique in the space B x C^([0, oo)) = {[p, L, M)} . 

Moreover, for any t the quantities Pn{t) define the probability measure 

p{t), that is Pn{t) > 0, Y.nPni't) = 1- 

Theorem 2. // Cx ^ C^ there are no fixed points. If C\ = Cf^ > the set 
of fixed points is a one parameter family {{Lg, Mg, iTsin))}, which depends on 
the parameter s ^M.. It is given explicitely by 



TcJn] 



-c{n~s)'^ 



y^g-c(n-s)2. 



Moreover, s 



Lg = s + \n 



M, = s - In 



Ls+Ms 



Cx 



Ca 



E.e 



-cil-s)'^ 



Efc^(A;)e-^(^'-^)'e^(-^+^) 



Theorem 3. If Cx = C^ > then there is a conserved quantity (invariant 
of motion) 

K = K{X) = L + M + J2^Pn- 

nez 



Any hypersurface defined by the value of K{X) contains exactly one fixed 
point. 

Speaking otherwise, the conserved quantity makes our phase space a fiber 
bundle over the real line, where each fiber contains exactly one fixed point. 

For the next theorem we need, besides condition (11.81) . the following con- 
dition: there is a positive constant C > such that for all tt, G Z 

inf^(n)>0, -^(n+l)-^(n) <-C, -f3(n - 1) ~ ^(n) < -C. (1.9) 
n&L e e 

This (very technical) assumption we will need only for proving conver- 
gence. Note that unfortunately this conjecture does not cover the case of 
linear drift, but fi{ri) = 1 satisfies (II. 9p . 

Theorem 4. Assume condition {\1.9^ . Then for any initial point X{0) such 
that the initial probability measure p{0) G B the solution converges to the 
unique fixed point on the hypersurface defined by the value of K{X{0)). 

Theorem 5. For any initial conditions X{0) such that the initial probability 
measure p{0) G B there exists a random process ^{t) = C,{t,X{0)) & 'Ij,t & 
[0,oo), with probability meausure P = Px{o) on the set X{t) of trajectories 
such that 

P{m = n)=Pn{t). 

A such that the k-dimensional distributions of ^{t), for k > 1, are defined in 
Markovian way by 

Px{o){Citi) = ni,...,^{tk) = Uk) =PnAti)Px{o){n2,t2\ni,ti)...Px(o)ink,tk\nk-i,tk^i] 

(1.10) 
Under condition U.y\) . the k-dimensional distributions of ^{t) tend as t —)■ oo 
to the corresponding k-dimensional distributions of the stationary Markov 
process rjt defined above. 

Let us note that while proving Theorem 1, we construct a family Px(o) {n, s\m, t), 
t < s,m,n E 1j, oi stochastic matrices satisfying the semigroup property. 
Thus the latter theorem is just the definition of the process ^(t). Formula 
(II.IOP looks like it defines a time inhomogeneous Markov process, but in fact 
it does not, since the transition kernels Px{o){','\',') depend on the initial 
conditions. 

Acknowledgments. KV would like to thank Yuri Suhov, Henry McKean 
and Raghy Varadhan for stimulating discussions. Both authors would like to 
thank Vadini Malyshev for his interest in this work. 
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2 Proofs 

Everywhere we will omit the parameter c assuming c = 1. To simplify nota- 
tion we denote the pair of functions L and M by Z{t) = {L{t), M(t)). 

2.1 Existence and uniqueness 

Here we will prove Theorem 1. The scheme of the proof is the following. 
Assuming that the continuous functions L{t), M{t) are given, we prove that 
the solution of (ll.4p exists and is unique in the appropriate Banach space, 
moreover it has some necessary properties in this space. Then we substitute 
this solution to the equations fll.5m.6p . thus obtaining two ODE with two 
unknown functions, and prove that the solution of these two equations exists. 

Two Banach spaces. Consider the Banach space S^, which consists of 
infinite sequences {vk, A; G Z) of real numbers with the norm: 



,%-+a|fc| 



^6 2 -''^'IZ/fcl, 

fcez 



and the Banach space B^ with the norm: 






>-^-"l'=l|/. 



Everywhere below a is an arbitrary fixed real number. Let us explain the 
meaning of these Banach spaces. B^ is the space of admissible measures of 
the process. B^ is the space of admissible functions. The natural duality 
between Bt and B~ is 



/) = E^«/"' i^eB^JeB-^ 



nez 
It is easy to see that 

l(^,/)l<IIH 

The space of bounded operators, acting on B'^ and B^, we denote by C{B'^) 
and C{B~) correspondingly. The operators are acting on B^ from the right, 
and on B~ from the left. 

Finally note that for any ai,a2 G M, such that ai > 0^2, the following 
inclusions hold B^_^ C B^^ and B~^ C B~_^. We will use these properties 
below. 



Transition probabilities. Assume now that L{t) and M{t) are some fixed 
continuous functions on M_|_. We will prove that the Markov process, defined 
by the Kolmogorov equations (11. 4p for Pn{t) exists and is unique in B^. 
Denote by P{t,s), t < s the family of its transition probability matrixes, 
H{t) - the infitesimal matrix. Let HQ{t) and V{t) be a diagonal and off 
diagonal parts of H{t) correspondingly. 

First we present a useful formula for the transition probabilities valid 
for a denumerable inhomogeneous continuous time Markov chain. Denote 
Ak{t,s) = {(si, . . . , Sfe) G M'^ : t < Sfc < . . . < Si < s} the fc-dimensional 
simplex. 

Lemma 1. Let Xt be a continuous time inhomogeneous Markov chain with 
denumerable state space and the family of transition probability matrices 
P{t,s), defined for < t < s < oo. Denote by H[t) an infinitesimal ma- 
trix of Xt. Let Hoit) and V{t) be a diagonal and off diagonal parts of H{t), 
then for any t < s the series 

P{t,s) = e-''*'^°(')'^'+ 

oo „ 

k = l -^ ^kit,s) 

(2.1) 
is absolutely norm convergent for some norm \\ ■ \\, if sup ^^u gi \\V{u)\\ < oo. 

Proof. Formally the series is obtained by the iteration of the following for- 
mula 

P(t,s)-eJ'*'^°(^)'^^= f P{t,z)V{z)e^^^''^'^'^'dz. 

Since all diagonal terms of eJ ^ois)ds ^^ j^^^ exceed 1, then using sup„gu ^i || V^(ti) || < 
oo, and the formula for the volume of the simplex we get the result. D 

We want to prove that the corresponding series converges in B'^ and the 
matrices P{t, s) are stochastic and satisfy the Chapman-Kolmogorov equa- 
tions. In order to do this we have to check that V{t) are bounded operators 
in i?+. First we will prove a technical lemma which will explain the condition 

Consider the following infinite three-diagonal matrix 



/ \ 

A^n-l A„_i 
V = fJ'Ti Xn 

V / 

We will consider V as the operator acting on infinite sequences from the 
right and from the left. 

Lemma 2. There exists a sequence {c„} , rz G Z c„ > such that V is a 
bounded operator in the Banach space with the norm 



/ ^ Cji I Xn I 



nGZ 

if and only «/sup„gg A„^„+i < oo. 

Proof. We will prove this lemma for the case when V is acting from the right. 
For the action from the left the proof is similar. 
Necessity. Let V be bounded. Then if e„ = (5o n 



-7^ — ::- = 7. — 7. = ^^n H A„ < \\V W = const. 



p p c 

1 1 c-n II II c-n 1 1 <--«, 

Whence we have a double inequality 

A'n+l , Cn+l \\V\ 



V 



Xr. 



This gives the necessary conclusion. 

SufRciency. Assume that sup^^^ A„y[x„_|_i < oo. A straightforward calcu- 
lation shows that for 



we get 



|e„yi 



Xq . . . A„_i 



yXn-lUn + yXnlJ.n+1 < OO. 



D 



Applying this lemma to the our case we see that the condition fll.Sp is 
spelling natural. Indeed 

A„(t)Ai„+i(t)=/32(n)e^W-^^W, 

therefore the condition of Lemma [2] is equivalent to fll.Sp . 

Lemma 3. Consider the operator valued function V{t), defined above. Then 
this function takes values in the set of hounded operators in C{B^), or in 
£{B^). Moreover, it is continuous and 

||y(t)||^<const(e-*^W + e^W) 

for any t. 

Proof. Consider an arbitrary vector u G B^. We have 

< const^e^+"l'=l-'=+i+^(*Vfc-il +const^e^+"l^l+'=+i-*^(*Vfc+il = 
fcez fcez 

= const ^(e^+°l'=+i|-'=-i+i+^W + e^+"l'-^l+'-^+^-'''(*))|i^fc| = 



fcez 



fc?__i_i_L„,ij,_i_ii_i_r /'+^ k^,i_ 



const J](eV+i+-l'=+i|+^W +eV+H"l^-i|-^^W)|;y,| < const(e^W + e-^"^^MIIz/ 

kez 



M(t)\ 

"a ' 



Similar calculation for any / G B~ implies the inequality for ||V^(t)||„. 

It remains to check that V is continuous in t. We will do it for the space 
B'^ only. For B^ it can be verified along the same lines. As in the estimates 
above for any arbitrary nonzero v G -B~, and arbitrary ti, ^2 we have: 



'V{ti) - yV{t2)\\l < const(|e^(*i) - e^(*^)| + |e~*'(*^) - e" 



M{t2)\ 



Together with the fact that L(t) and M{t) are continuous, this implies our 
statement. D 
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Lemma 4. Let t < s. Then the series /i2.1\) converges in both norms of 
C{B^) and C{B~) and therefore defines the bounded operator. Moreover, 

\\Pit,s)\\^ < exp(const(s - t) sup (e'^^W + e^^)). 

te[o,s] 

Proof. Let us prove the lemma for B^ . Arguments for B^ are exactly the 
same. First, note that Lemma [3] implies that for any t < s 

sup \\V{t)\\+ < const • sup (e-^^(*) + e^^). (2.2) 

te[o,s] te[o,s] 

Since Hq consists of negative numbers, then for any ti < ^2 we have ||e''*i °^'^' '^||q < 
1. Using that the volume of the simplex Afc(t, s) is -^^-^r", and the estimates 
above, we obtain: 

^(supro,i||y(t)|| + )^(s-t)'= , . ,„,,.„ + 

K. 

k=l 

n 

Approximation by finite Markov chains. Lemma H] states that for any 
t < s the operator P{t, s) is defined in the spaces B'^. It remains to prove 
that they define a Markov process. For the proof we need to introduce new 
notation. 

Define truncated Markov processes X"^ as the restriction of X on [— m, m]. 
More exactly X"^ has the infinitesimal rates 

k^k+1: A^(t) =/3(A;)e~^'+^(*), ke[-m,m-l]; 

k^k-1: fi'^{t) = [5{k-l)e^-^^^\ ke[-m + l,m]. 

Let //™ = H^{t) be the infinitesimal matrix of X™. Similar to what we 
have done before we write H^ in the form if™ = if™ + y™, where if™, y™ 
are its diagonal and off diagonal parts. For X™ obviously holds the formula 
analogous to (12. ip 

oo „ 
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Lemma 5. 1. For any n G B^ and any t < s: 'KP^{t,s) — j-m-^oo T^P{tiS) 
in the sense of the norm || ■ ||+; 

2. For any n G B^ and any t < s: P"^{t,s)7r -^m^oo P{t,s)n in the 
norm \\ ■ ||^. 

Proof. We will give a proof only for B^. For B^ the proof is the same. 
Fix some < t < s and define 

r-(.i, ...,s,):= ire^^^' ^«(^)'^^y(.,)e/4'=-^ ^oW<^s _ _ _ v{s,)e^^\ '''^'^'''- 

where {sj^'^.^i G Afc(t, s). It is easy to check that Tre-'*! " ^^' * — J-m^oo Tre-'*! "^^-^^ 
in the sense of the norm || ■ ||+ for ti < ^2, and nV^it) -^m-too T^V{t). There- 
fore in the norm 

for all sets {sj}*^^^, which belong to correspondent simplex. Let us estimate 
the difference of the A;-th terms Ak and A™ of the series for TrP{t, s) and 
7vP"^{t,s) correspondingly 



\\Ak-A^\\+< / ||r-(si,...,Sfc)l|+dsfc...dsi. 

Using the estimates, similar to the one used in Lemma HI it is easy to check 
that ||r'"(si, . . . , Sfc)||^ bounded on simplex, namely: 

||r"(si, ...,Sk) 11+ < 2||7r|| + (const- sup(e-"'^W + e^«))^ 

[0,.] 

Therefore, Lebesgue theorem implies that: 

/ \\r"'{si,...,Sk)\\adsk...dsi -^m^oo 0, 

J Alr(t.s) 



Ut-J- /ii, L, >-m_-!.no U. 



'Ak(t,s) 

i.e. 

Ifc ^k \\a ^m— !>oo 

Moreover, using a formula for the volume of simplex it is easy to get, that: 

k 

\\Ak ~Ant< ^2||7r|| + (const- sup(e-"^W + e^«))^ 

l^- [0,s] 

i.e. YlT=i ll^fc ~ ^rlla converges uniformly in m. 
We will use the following simple 
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Proposition 6. Let the series YlT=i ^km converge uniformly inm = 0,1, . . . , 

ana Ukm ^m— >oo U, ttien 2^k=l ^km ^m— i-oo U. 



Using this proposition we liave: 

oo 

||^P™(t, s) - nP{t, s)\\t<J2\\Ak- AX ->--.oo 0. 

fc=i 

Therefore ||7rP-(t, s) - TvP{t, s)\\+ ^„,^^ 0. D 

Corollary 7. The matrices P{-,) satisfy the Chapman- Kolmogorov equa- 
tions. 

Proof. It is apparent that for a\\ t < u < s, and m G N, the Chapman- 
Kolniogorov equations hold 

P'^{t,u)P'^{u,s) = P'^{t,s). 

Fix some tt G S", then 

Ti[P{t, u)P{u, s) - P{t, s)] = n[{P{t, u) - P'^it, u))P{u, s) + 
+ P^'it, u){P{u, s) - P'-iu, s)) + (P'"(t, s) - P{t, s))] = 
7r[(P(t, u) - P'^it, u))P{u, s) + {P'^it, u) - Pit, u)){P{u, s) - P'^iu, s)) + 

+ Pit, u)iPiu, S) - P^{U, S)) + (P™(t, S) - P{t, .3))]. 

Using Lemma [5] and the uniform boundness in the norm P^{t,s) on the 
segment \t, s\ (easy to check), we obtain, in the limit m — )■ oo, the required 
statement. D 

Corollary 8. The matices P(-, ■) are stochastic. 

Proof. Let h G B~ be the vector which consists of all I's (i.e. for any 
z G Z, /ij = 1), then for any m G N, t < s we have: 

(P"(t, s)h), = Y,^P"\t, s)),, = 1 =^ P^{t, s)h = h. 

Using Lemma O we obtain in the norm 

P'"\t,s)h^P{t,s)h. 

13 



Since P"^{t, s)h = h, the latter formula implies: 

P{t,s)h = h, 



but this means that: 






D 



Remark. In the Corollary [8] we used the fact that the chain is not exploding. 
In those cases when the trajectory runs to infinity it is impossible to adjust 
the norm || ■ ||~ such that the vector h, which consists of all I's belongs to 
this space. However, and in these cases the matrix P(-, ■) can be defined, but 
it will not be stochastic. 

Corollary 9. The family P{t, s) , t < s is continuous in t and s in C{B^). 

Proof. Since P{t, s) satisfies Kolmogorov- Chapman equations, it is enough 
to prove that P{t, t + ti) is continuous at zero as a function of ti. Using the 
formula ( 12.1 p and the estimates analogous to those of Lemma IH we have: 

||P(t,t + ti)-Id||±<||e/*^''^"(^)'='^-Id||±+ 

+ (exp(const-ti sup (e-^^^^^ + e^^"))) - 1) ^t,^o 0. 

This implies our statement. D 

Lemma 10. Distribution p{t) G B^ as a function of time is real analytic on 
M+. The solution of ([i.^[j is unique in the class of real analytic functions on 



Moreover, the solution of ( [j.^[ j is unique in the class of continuous func- 
tions p{t) in B^ . 

Proof. It is easy to check that for the remainder Rn{t) of the series (??) we 
have ||-Rn(^)ila = 0(t"'). Moreover, it is easy to check that Pk{t) is infinitely 
differentiable. These two statements imply the result. 

Let p^{t) and p'^{t) are two different analytic solutions of ( II. 4p . then their 
difference p{t) = p^{t) — p'^{t) is a solution of (IL4p with trivial initial data 

p(0) = 0. 
14 



Then it is easy to check using induction in /, that for any k & "ZJ E Z_|_ 

PkiOf^ = 0. 

Then due to the condition of the lemma Pk{t) = for any A; G Z. 

The proof of the last assertion is similar to the calculations made in 
Lemma [U Actually since 

dz \ / 

integrating from to t we get 

rt 

Jo 
Now iterating this formula we conclude: 

n „ 

p{t) = p{0)e^oHo{s)ds^Y^ / p(0)e^o' ^«W'^^V^(sfc) . . . y(si)eA ^"(^^'^^dsfe . . . ds^+Rn+i, 

where 

-Rn+l = / p{Sn+l)V{Sn+l) ■ ■ ■ V{si)e^'i ^°'''''''^'' dSn+1 . . . dSi 

JAn + l{0,t) 

converges to 0. D 

Thus, we constructed family P(-, ■), which consists of stochastic matrices 
and satisfies (IL 



Local existence and uniqueness of the nonlinear system. In this 

section we consider the original problem with Z = (L, M) which satisfies the 
system of differential equations fll.4p - flL6p . From the formal point of view, to 
prove that the process is defined on the segment [0, T] (T > is arbitrary), it 
is necessary to solve the infinite system of differential equations for the pair 
{p, Z). However, as it was shown above for any Z G C[0,T] x C[0,T], there 
exists the unique Markov process Xz, having transition probabilities Pz{-,-), 
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the infinitesimal matrix Hz{t) and the distribution pz{t) at the moment t. 
By substitution one can get a closed system of differential equations for Z: 

L'{t) = -p{0)Pz{0, t)Xz{t) + Cx, ,^ „. 

M'{t)= +p(0)Pz{0,t)Mt)-C, ^ ' 

with the initial data 

L(0) = Lo, 
M(0) = Mo, 

where Xz{t) and fiz{t) are transition rates for Xz{t). Thus one takes out p{t) 
from consideration. 

Introduce the necessary notation. Fix some R > max(|Lo|, |Mo|). Let 
B{T,R) = {/ e C[0,T] : maXig[o,T] \.f{t)\ < R} be the closed ball in the 
space C[0,T] of continuous functions on [0,T], equipped with the uniform 
metrics Pb{t,r)- We consider the space B(T,Ry = B(T,R) x B(T,R) with 
the metrics 

p{Zu Z2) = pULi, Mi),{L2, M2)) = PB(T,R)iLu L2) + PB(T,R)iMl, M2). 

It will be convenient to take the parameters Lq,Mq equal to zero. This can 
be done by shifting the coordinates. 

In the estimates below we will use some unknown functions of initial data 
Lq, Mq, R, T etc. By c(. . .) we denote any nonnegative function, nondecreas- 
ing in each of its arguments. 

Lemma 11. Let p(0) G fi+, ^1, ^2 e B{T, Rf, then for any t G [0, T] 

|b(0)Pz,(0,t)-p(0)Pz.(0,t)||+_i<c(i?,T,|b(0)|| + ,|Lo|,|Mo|)p(Zi,Z2). 

(The left side of the inequality is defined, since B^ C B^_i.) 

Proof. First we prove that Hzj^ (t) — Hz2 (t) is a family of bounded, contin- 
uous in t operators, acting from B^ into -B^^-i- Let us estimate their norm. 
For arbitrary u G B^ we obtain: 

WuHzAt) - i^HzMlLi < IWVzAt) - i^Vz,it)t-i+ 
+ \\iyHoz,{t) - uHozMWa-i ■= h{t) + hit). 

Let us estimate each term separately. 
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a. We have 

hit) = WuVzAt) - i^VzMlLi < 

feez 
- /3ik - l)e-'^+i+^2W+^Vfc_i - /3(A;)e'=+i-^^2W-^'Vfe+i|e^+("-i)l'=l < 

feez 

+ const ^ |e-^iW-^o - e-^^W-^"] ■ |e'^+Vfc+ie^+("-i)l'=l| < 
fcez 

< const||//||+_i|e^^W+^» - e^^W+^°| + const ||z/||+_i|e-^^W-^" - e-^^^W-^»| < 

< c{R, |Lo|, |Mo|)p(Zi, ^2)11^^11+-! < c{R, |Lo|, |Mo|)p(Zi, Z2)||/v|| + . 

b. Note, that iJoZi2('^) ^^^ diagonal matrices, therefore 

hit) < J2 |/9(A:)e-^+^^+^« + /3(A; - i)e''~M,-Mo _ p^k)e~k+L2+Lo _ ^(^ _ ^yk-M^-Uo^ 

■ Wk\ ■ e^+("-i)l*^' < const J2 le'''^^" - e^'^^"l ' I'^fel ' e-^+^+("-i)l*^' + 

+ const J2 |e-^i-*'" - e-^2"^"| ■ |z/fc| • e'=+^+(°-i)l^'l < 

fcez 
<c(i?,|Lo|,|Mo|)p(Zi,Z2)||z/|| + . 

Using a. and b., we have: 

\\HzAt) - Hz,m <<R,\Lo\,\Mo\)p{Z^,Z2), (2.4) 

where || ■ || is a standart supremum norm. Continuity in t of Hz^{t) — Hz2{t) 
can be checked in the same way. 

Now we are going to prove a useful inequality which we will employ later. 
Consider r(t) = P^,(0, t)P^2(t, T), t e [0,T] and differentiate 

jT{t) = PzMt)iHzAt) - Hz,it))PzAt,T). 
Due to the results of section 1 the following sequence of transformations holds 
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Therefore J^r(t) is a family of bounded and continuous in t operators acting 
from B^ into B^_i. Integrating from to T, we obtain: 

PzMT) - Pz,it,T) = f PzMtKHzAt) - Hz,{t))Pz.At,T)dt. 

Jo 

Then 



I:=MO)PzMt)-p{0)PzMmt-i< 

< lb(0)||+ f WPzMmt ■ WHzAt) - Hz,m . \\Pz,{t,T)\\t_,dt. 
Jo 

Using (12 ■4p and the estimate of Lemma HI we get 

/<c(i?,T,|b(0)|| + ,|Lo|,|Mo|)p(Zi,Z2). 

D 

Lemma 12. For any initial data Lq.Mq G M, jo(0) G B'^ the system ^2.3\) 
has a unique solution for t sufficiently small. 

Proof. First we verify that for any Z G B{T, R)"^ the function 

{piO)PziO,t),Xzit)):R^R 

is a function continuous on the segment [0, T]. From Lemma [9] it follows that 
p{0)Pz{0, ■): M — )■ B^ is a continuous function. Moreover for any t G [0,T] 
and fc G Z 

MO)Pz{0,t)),\ < \\pmt\\Pz{0,t)\\te-'^-^^'\ 
and 

|(p(0)Pz(0,t)),A.z(t)|</3(fc)e^W+^°|b(0)|| + ||P^(0,t)||+e-^-("-i)l'=l. 
Therefore the series 

{p{0)Pz{0,t),Xz{t)) = J2iPi^)Pz{0,t))kXz{t)k 

fcez 
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is majorized by a uniformly convergent series on [0,T]. That implies our 
statement. It is proved analogously that for any Z G B{T, R)"^ (p(O)F^(O, ■), fJ-zi')) 
is a function continuous on [0,T]. 

Now we can rewrite (12. 3 P in the integral form: 



Ht) = - /o [(KO)Pz(O, s),Xzis)) - Cx]ds, 
M{t) = jtMO)Pz{0, s),fiz{s)) - C,]ds. 



It is sufficient to check that for sufficiently small T the following map is 
contracting in B(T, i?)^ : 

(m\ (-j;^[{p{0)Pz{0,s),Xz{s))-C,]ds 
■ \M{t)) V j;,MO)Pz{0,s),^z{s)) - C,]ds 

We have to check first that we can find such T that the above map maps 
B{T, RY into itself (we assume that R is fixed ). 

Denote Fj,, Fm the projections of F onto the first and second coordinates 
and estimate 



\\z{s)\\-ds+ 



|Fi(Z,t)|< f MQ)Pz{Q.s),\z{s))\ds+tC^< f \\p{0)PziO,s) 
Jo Jo 

+rCA<c(||p(0)|| + ,|Lo|,i?) f \\Pz{0,s)\\+ds + TCx< 

Jo 

<Tc(|b(0)|| + ,|Lo|, i?,T) + TCA. 

From this we see that we can find T such that for any t G [0, T] \Fl{Z, t)\ < R. 
Analogous estimate can be obtained for FM{Z,t), therefore for sufficiently 
small T we obtain, that FL{Z,t) and FM{Z,t) can not leave [—R,R], but 
this means exactly that F maps B{T, RY into itself. 
Consider the difference 

Fi(Zi,t) - Fi(Z2,t) = [ [(p(0)Pz,(0,s),Az,(5)) - (p(0)Pzi(0,s),Az,(s))]ds. 

Note that \FL{Zi,t) - FL(Z2,t)| < /(J(/(s) + J{s))ds, where 

I{t) = \{piO)Pz,{0,t),Xz,{t)-XzMl 
J{t) = \{p{0)Pz,{0,t)-p{0)Pz,{0,t),XzM\- 

19 



First we estimate I{t). Note that 

where $, G B~ is the vector with the components ^„ = /3{n)e~'^~^^° . Then 
j(^) < eM*)-^.W||p(0)p^^(0,t)|| + ||e||- < c(T,i?jLoUMo|, |b(0)||+)p(Zi,Z,). 
Now let us estimate J{t). From Lemma [TT] we conclude that 

Jit) < Mo)PzMt)-Pio)PzMt)\\i-i\\XzM\a-i < 

<ci\Lo\,R)\\piO)PzMt)-piO)PzMt)\\U< 

<c(i?,T,|b(0)|| + ,|Lo|,|Mo|)p(Zi,Z2). 

Thus, we have 

\FL{Z^,t)-FL{Z2,t)\<c{R,T,\\pmtALo\,\Mo\)tp{Z,,Z2). 

Analogous expression we get for \FM{Zi,t) —Fm{Z2, t)\. Then for sufficiently 
small T (remind that c(. . .) is nondecreasing function in each argument) we 
obtain that the map is contracting. D 

Using Lemma fT2] and the contraction, we obtain existence and uniqueness 
of the solution of the system (12. 3p for small t. It remains to prove that this 
solution can be extended to the entire axes. 

Global existence. In the previous section we have proved the local exis- 
tence and uniqueness of our process. In this section we will prove that the 
process can be extended to all R+. For this purpose it is sufficient to prove 
that L{t) and M{t) can not run off to the infinity. In other words there is no 
explosion in our model. 

Lemma 13. There exist positive nondecreasing functions /i and J2 defined 
on ]R_|_, such that 

-fi{t)<L{t)<Lo + Cx-t; 

Mo-C,-t<M{t)<f2{t). 
Proof. Note that integrating (12. 3p we get the first assertion: 
L{t) <Lo + Cx-t; M{t) >Mo-C^-t; 
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Therefore using 

||^z(0,t)||+ < const ■ exp(te^''*-*^« +te^^*-^«) := f{t). 

We see that f{t) is a positive nondecreasing function on ]R_|_. Applying 
(12 ■3p we have 

L'it) > -|b(0)Pz(0,t)|| + ||e||-e^W + C. > -C/(t)e^W + C, 



where C > is an arbitrary sufficiently large constant, and ^ = {e "}. This 

cf(-)-' 

L'(-) > 0. 



inequality implies that if L(-) < In „3, , thus 



Taking C large enough and such that L(0) > In -qjtq^ we conclude 

iW > in ^ :=/.(*). 

Analogous estimates can be made for M{t). D 

The Theorem 1 is proved. 

2.2 Stationary points and the conserved integral 

Here we will prove Theorem 2. We already saw that if at least one fixed 
point exists then C\ = C^. Now we will find the fixed points explicitly. 

Let (tt, L, M) is a fixed point of X. Note that L, M are real numbers. 
The invariant measure tt can be uniquely identified with our discrete gaussian 
measure, introduced above 

1 <^ „^2 



7r„ = ;^e-("-^) 



-{n—s)^ 



where H = Y.nei ^~ 

Thus we are left with the following two equations 

^ ie-('=-^)'/3(A;)e-'=+^ - Ca = 0; 
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Let us rewrite the first equation in terms of s and d 



-(fe-s)2g-fc+S 



fcgz fcez 

Tlie expression for d follows 



El e-('-^)^ 



d = In 



Ca 



E.e 



-a-s)2 



Efc/?We- 



-{k—s)^ p~k+s 



Then 



L = s + d = s + In 



C. 



E,e 



<l-s? 



Y,k(i{k)e-^^~'y'e-^+' 



and similarly 



M = s - In 



Ca 



E.e- 



-(Z-.)2 



^fc/3(A;)e-('=-^)'e-'=+^ 



Now we will prove Theorem 3. Namely, we will show that the system of 
equations fll.4|1.5|1.6p has the following integral of motion 

K{t) = 2s{t) + Y, kpkit) = Lit) + M{t) + Y, kPkit). (2.5) 

Summing up equations for L and M, we have 

{L + My{t) = - J]pfc(t)Afc(t) + 5^pfc(t)^fc(t) = -(J]A;pfc(t)y. 



kez 



fcez 



kei 



It remains to prove that {Ekei^Pkif))' = J2 Pk{t){hit) - fik{t)). Using 

fcez 

estimates (12. 8p (we will prove it below), it is easy to see that the series 

Ekei^Pki't) "^^^ be differentiated term by term. Thus: 

(Y ^Pk{t))' = Y KPk-i^k-i - {^kPk + /ifcPfe) + ^^k+lPk+l) = 

fcez feez 

^{((A; + 1) - k)XkPk + {-k + {k- l))tikPk} = 5]^Pfc(0(Afe - /ifc). 

fcez 



22 



2.3 Convergence. 

Here we will prove Theorem 4 assuming both conditions on /3{n), introduced 
above, namely (11. 8p and (11. 9p . 

We will define two Lyapunov functions. The first of them Q{t) will be 
positive and decreasing along the trajectory outside some special set. The 
second W{t) decreases along a trajectory everywhere, but can take big neg- 
ative values. Using these two functions we can prove the convergence. 

Boundness of L and M. Note that the pair of equations for L and M 
are equivalent to the following pair of equations 

r s'it) = -ie-^ (EnezPn/3(n)e-"+^ - En&Pnl3in - l)e"-^) ; 

\ d'it) = -\e' (E„«Pn/3(n)e-"+^ + E„ezPn/3(n - l)e"-) + C^. ^^'^^ 

We will use the following 

Proposition 14. // the terms of the absolutely convergent series u{x) = 
Yl'^=i "^nix) are continuously differentiable on the segment [a, b] and the series 
of derivatives Yl'^=i''^'ni^) converges uniformly in {a,b), then 

, oo oo 

— ^M„(X) = ^<(X). 
n=l n=l 

In order to use this statement we have to make additional estimates. If 
p{0) G B^, then ||p(t)||Q < const for any sufficiently small segment [0,r]. 
This implies for any t G [0, T] 



fe 



bfc(t)|<e---"l'=l|b,(t)||+< const ■e---"l'=l. (2.7) 

From this, using the formula for p'k{t), it is easy to see that for any t G [0, T] 

b^(t)| <conste-^-("-i)l'=l. (2.8) 

Moreover, we will need the following Grownall type result 
Proposition 15. Let /(•) be some differentiable function on [0, oo) such that 

/'(■)> (<M-)(Ci-c^2/(-)), C2>o 

where g{-) is a positive function. Then /(■) is bounded from below (above). 
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Define the first Lyapunov function (compare witli d'{t)) 
Q{t) = J^Pnit) (/?(^)e-"+^ + P{n - l)e"-^) 



n& 



Lemma 16. 1. Q{t) is bounded. 2. |X]fcez^^fc(0 ~"^(0I ^■^ bounded. 

Proof. 1. Using estimate f|2.8p . it is easy to clieck, tliat tlie series for Q'{t) 
can be differentiated term by term. First we find Q'{t) 



n& 



neZ 



Using (??) we note tliat tlie second component of tlie expression is less tlian 
0. So 

Q'ii) <Y.P'n (/3We-"^^ + ^{n - l)e— ) = e''^ 5^p:,(t)(A.(t) + A.„(t)). 



n& 



n& 



Using Kolmogorov's equations and opening tlie brackets we have 

Q'{t) < e~'^'^Pn{t) {A„A„+i + flnf^n-l + Kf^n+1 + f^nK-1 " 2A„/X„ " A^ - //^} . 



neZ 



Substituting expressions (11.31) for A„ and fj,n we have: 

Q'it) < e^ 5^p„(t)[/3(n)/3(n + l)e-2n-i+2s ^ ^^^ _ ^^^^^ _ 2)e2-i-2s ^ ^^s^^^^ 

ngZ 

+ e/3\n - 1) - 2/3(n - l)/3{n) - p\n)e-^^+^' - I3\n - l)e^'''-^'] := e" ^ ,S„(s)7r„(t). 

nez 

We state that for the just defined function S'„(s) 

Sn{s) + /3(n)e-"+" + /?(n - l)e"-^ < const. 

Indeed, putting x := e^~", we can rewrite this inequality in the following 
form: 



P{n) 



-/3(n+ 1) - I3{n) ] x^ + x 



+/3(n-l) 



-/3(n - 2) - /3(n - 1) x^ + x 



< const. 
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Therefore conditions fll.Sp and f ll.9p imply required inequality. Now we get 
Q'{t) < e'^^p„(t) (const - /3(ri)e-"+' - (3{n - l)e"-') = e'^(const - Q(t)). 

nGZ 

Using Proposition [TSl we obtain that Q is bounded. 
2. We have 

\^npn{t) -s{t)\ = \^npn-s\ = ^\pn{n-s)\ < 

nGZ ngZ nGZ 

< const Y^ \Pn\ (/3(n)e-"+' + /3{n - l)e"~") = const-g(t). 

nez 

It remains to use the boundness of Q. D 

Lemma 17. Functions L and M are bounded. 

Proof. Note that this statement is equivalent to the fact that s and d are 
bounded. Boundness of s directly follows from formula (12. 5p and part 2 of 
Lemma [IHl Boundness of d is proved as Proposition [151 since 

d'it) = -^e^Q(t) + Ca. 

D 

Relative entropy for constant L and M. In the nonlinear case we will 
prove convergence using the relative entropy method. In this subsection we 
will introduce auxiliary notions and lemmas for constant Z. 

li Z = const there exists only one invariant measure n, given by (11.20 . 
Define the entropy of the distribution p = p{t) relative to vr in the following 
way 

Hit) = H{p{t)\n) = ^p„ln^ = J^^n^ (-) , (2-9) 

where if{x) = xlnx. 

Remark. As the factor S adds a constant to H{t), everywhere below we will 
assume S = 1. Thus p{t) is just a finite (not necessary probability) measure. 
The fact that H{t) decreases in time is known [2]. We will show that the 
series (12. 9p is convergent and can be differiantated term by term. We will 
use the following technical lemma: 
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Lemma 18. For any e > there exists C=C(e) > such that for t > e 

lnj9n(t)>-Cel"l(l + t). 

Proof. Let n G Z_|_, po{0) > 0. We will make a very rough estimate. It is 
evident that p„(t) is greater than the product of the following probabilities: 

• The probability Pi that at the moment t = the particle is at the point 
0. 

• The probability P2 that the only jumps before time t are as follows: 
from to 1, from 1 to 2, etc., from n — 1 to n. 

Otherwise speaking 



Pn{t) > PoiO) 



Y] ( /3(n)e-"+^ 



-(/3(n-l)e"-*-f+/3(n)e-"+^)t 



(min„ (/3(n - l)e"-^^ + /3(n)e-"+^) tf j^^^_,^,.^m^,^^,^..,.^', 



n\ 



> 



n\ 

Taking the logarithm, we get the requested assertion. Similar calculation 
can be made in the case po{0) = 0, Pk{0) 7^ 0, fc 7^ 0, and n G Z^. D 

Corollary 19. The series Ii2. 9\) is well defined for t > 0, and for t > it 
can be differiantiated term by term. 

Proof. Whereas (12. 7p it is easy to see that the series (12. 9p converges on any 
sufficiently small interval. Using Lemma [18] we get that the corresponding 
series of derivatives uniformly converges on any interval enough small. The 
corollary implies Proposition [TH D 

Lemma 20. For t > 

The equality is attained as soon as p{t) = n up to multiplicative factor. 
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Nonlinear case. Now we will consider the case when Z = (L, M) satisfy 
equations ( ll.5fl.6p . Similarly we define 



TT^ = e-(^-")' 



and the relative entropy 
H{t) = H{p{t)\n^) = J2pn\n^ = 5^P„(lnp„ + (s - nf). (2.10) 



vr„ 



The measure vr* is not stochastic because we prefer not to normalize it. 

First of all we have to check that the series (I2.10p converges and can be 
differentiated term by term. Taking into account that L and M are bounded 
we can prove the technical lemma similar to Lemma [ 



Lemma 21. Let e > be a fixed number. Then there exists C = C{e) > 
such that for t > e 

lnp„(t) > -Cel"'(l+t). 

Corollary 22. The series Ii2.10\) is well defined for t > 0, and for t > it 
can be difjeriantiated term by term. 

Define 

W{t) = H{t) + 2Ks{t) - 3s2(t), 

where K = 2s + J2n&z''^Pn{t) = const is the invariant, introduced above. 
Lemma 23. For t > 

Iwit) < 0. 

The equality is attained as soon as p{t) = tt* up to multiplicative factor. 
Proof. For t > the series fl2.10p can be differiantiated term by term. Thus 

^H{t) = ^.^ + ^.^. (2.11) 

dt OTT dt OS dt 

The first term of the right side represents a derivative of the relative entropy 
for fixed s, therefore, using results of the preceding subsection, we conclude 
that this term is negative. Let us calculate the second term 
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neZ neZ n&Z nSZ 

Using the invariant K we get 

^ ■ ^ = 2ss' - 2s'(ir - 2s) = 6ss' - 2s' K = (Ss^ - 2Ks)' 
ds dt ^ ' ^ ' 



and by f|2.1ip we get 



^{H + 2Ks-'is^}<Q. 



u 



Corollary 24. Let p{0) G B^ and Lo,Mo,q: G M 6e arbitrary numbers. Then 
the convergence holds. 

Proof. In Lemma [23] we introduced the function W = W{p,Z), which can 
be considered as the Lyapunov function. Therefore the proof has a quite 
standart scheme. 

First, p{t) belongs to a bounded (supremum norm) closed subset of the 
set Co(Z) of functions / on Z = ZU{oo}, continuous at infinity and such 
that /(oo) = 0. That is 

{Pit)}tm+ C 5+ n {^ = {AiJ : /i„ > 0,5^/i„ = 1} C Co(Z). 

neZ 

It follows that the domain of W lies in a compact subset of Co(Z) x R^, as 
Z = [L, M) is bounded. 

Therefore the trajectory {{p{t), Z{t))} has at least one limiting point. Let 
(tt*, Z*) be one of such points. As W decreases along the trajectory 

This follows from continuous differentiability of W{t). Using Lemma [23] 
we conclude that tt* = e"^'' ~'^'' up to some factor. 

Using the invariant it is easy to check that s* is defined uniquely. In the 
introduction we mentioned that the trajectory of {p, s) does not depend on 
the choice of d. Therefore {p,s) converges to (7r*,s*). It remains to show 
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that d converges to d*. Remind that we can rewrite the equation for d in the 
following form 

d' = -^e'^Qit) + Cx, 
where 

Note that due to the established convergence of s and p 

Q{t) -J-t^oo Q* = const. 
We have an ordinary differential equation which can be solved explicitly 

^ Jo 

As Q(t) converges we obtain the required result. D 
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